Web Survey Bibliography
Open ended questions can surface both unusual responses and assess the salience of ideas in a respondent population. This paper discusses results of surveys in an open ended format called the essay survey. The surveys consisted of a single, very general, open ended question beginning with "Please write your thoughts about cigarette smoking" and continuing with some very general guidelines with minimal suggestions about what the thoughts should be. The survey was administered to both university undergraduates and a national Internet sample from Survey Sampling International. Salience was inferred from the frequency of scored ideas in the respondent text and was found to differ by no more than 3 percent between the two populations for 85 percent of the 26 scored ideas from about 1000 sentences from each of the two populations. The method had high sensitivity for both rare and common ideas that were present in 0.02 to 19 percent of the respondent sentences.
The responses were scored by computer using the InfoTrend software (U.S. Patent 5,371,673 and patents pending). This software allows the user to specify key words and phrases as well as how words in sentences or paragraphs can be combined to give complex meaning. For example, the user can specify that "not" to the left of "support" to the left of a political candidate name can lead to an unfavorable score for that candidate. The user writes scoring algorithms in ASCII text so that any subsequent user will have an unambiguous understanding of the meaning of the scores. Repeated benchmarking shows that the accuracy of the machine scoring is the same as that among human coders for complex ideas. The software is accessed via the Internet through a password protected site.
Homepage (abstract)/(presentation)
Web survey bibliography (4086)
- Machines that Learn how to Code Open-Ended Survey Data: Underlying Principles, Experimental Data, and...; 2008; Sebastiani, F.
- Computer coding of 1992 ANES Like/Dislike and MIP responses; 2008; Fan, D. P.
- CATA (Computer Aided Text Analysis) Options for the Coding of Open-Ended Survey Data; 2008; Skalski, P.
- Classifying Open Occupation Descriptions in the Current Population Survey; 2008; Conrad, F. G., Couper, M. P.
- Coding Responses Generated by Open-Ended Questions: Meaning Matching or Meaning Inference?; 2008; Potter, Ji.
- Open-ended questions and text analysis; 2008; Popping, R.
- Coding Verbal Data - What to Optimize?; 2008; Krippendorff, K.
- An evaluation of the weighting procedures for an online access panel survey; 2008; Loosveldt, G., Sonck, N.
- The adequacy of response rates to online and paper surveys: what can be done?; 2008; Nulty, D. D.
- Validity of an On-Line Panel Approach to Citizen Surveys; 2008; Van Ryzin, G. G.
- Internet dating: a British survey; 2008; Gunter, B.
- Survey of Web Developers in Academic Libraries ; 2008; Connell, R. S.
- Online vs. face-to-face discussion in a web-based research methods course for postgraduate nursing students...; 2008; Campbell, M., Gibson, W., Hall, A., Richards, D., Callery, P.
- Using Web 2.0 to Conduct Qualitative Research: A Conceptual Model ; 2008
- Testing telephone and web surveys for studying men's sexual assault perpetration behaviors ; 2008; DiNitto, D. M., Busch-Armendariz, N. B., Bender, K., Woo, H., Tackett-Gibson, M., Dyer, J.
- Integrating Qualitative and Quantitative Research Methods: Uncovering Emotional Drivers From Qualitative...; 2008; Reid, Aa.
- Mobile Research: Five Ways To Collect Data Using Mobile Devices; 2008; Conry, S.
- Best Practices For Identifying Duplicate Respondents; 2008; Ouren. J., Dickie, W. J., Chokeir, N.
- Engaged Respondents Are Better- Innovative Techniques To Improve Response; 2008; Sleep, D.
- Analytic implications of panel data quality; 2008; Harlow, B.
- Measuring the value of respondent engagement; 2008; Puleston, J., Sleep, D.
- Pavlov revisited; 2008; De Wulf, K., Friedman, M., Borggreve, B.
- Between random samples and online panels; 2008; Crassweller, A., Rogers, J.
- Digital moms; 2008; Wilbur, C. Rimmer, L.
- Research Instruments: Driving e-Science? ; 2008; Schroeder, R.
- The US Institutional Review Board and Online Research Ethics; 2008; Markham, A., Buchanan, E. A., Ess, C.
- Getting animated about emotion; 2008; Penn, D.
- Can online panels be truly global?; 2008; Shashkin, A. V.
- Digital video at the service of research; 2008; McClure, S., Renard, M. C.
- Realism in research; 2008; Richarme, M., Colias, J.
- What Can We Achieve With 5 Euros? Optimization of Survey Data Quality Using Mixed-Mode Approaches; 2008; Berzelak, N., Vehovar, V., Lozar Manfreda, K.
- Measuring Non-Response Cross Nationally; 2008; Blom, A. G.
- Use of a website to evaluate quality of work-life and quality of life among community workers helping...; 2008; Dupuis, G.
- Comparing the network structures in teams among companies: Extensions of the MTML approach; 2008; Agneessens, F., Contractor, N.
- Online poll in study of incentives to participation of youth in innovative development; 2008; Gvozdeva, E. S.
- Measuring ties on online forums; 2008; Ziberna, A., Vehovar, V., Jakulin, A.
- Using Internet Pages of Organisations as Data Source for Social Science Research; 2008; Baumgarten, B., Grauel, J.
- Social Web Data as a Source for Social Science Research. The Example of a German Online Dating Website...; 2008; Skopek, J., Schmitz, A.
- DHS CAPI Data Collection Model Using PDAs; 2008; Rojas, G.
- The relative Coverage Error in Telephone Surveys caused by Mobile-Only Populations across Europe; 2008; Fuchs, M.
- Chaotic Web: The challenge of Misinformation and Disinformation; 2008; Keshavarz, H.
- Mixed methods in online evaluation: benefits and problems; 2008; Kuckartz, U.
- Use of the Internet as a data collection tool: a methodological investigation of online synchronous...; 2008; Evans, A. R., Elford, J., Wiggins, D.
- How can we convince the general public to respond to internet surveys?; 2008; Dillman, D. A.
- Nonresponse in web surveys within the context of survey errors and survey costs; 2008; Berzelak, N., Lozar Manfreda, K., Vehovar, V.
- The accuracy of online surveys with non-probability samples; 2008; Krosnick, J. A.
- The Danish time use and consumption survey 2008/9 - preliminary experiencies from applying a combined...; 2008; Bonke, J.
- On the feasibility of collecting biomarker data in an internet panel; 2008; Avendano, M., Mackenbach, J.
- Exploring the use of visual analog scales in web surveys; 2008; Couper, M. P.
- Internet access and cognitive ability: analysis of selectivity of internet interviews in the cognitive...; 2008; Willis, B.